Towards human-level performance on automatic pose estimation of infant spontaneous movements

Assessment of spontaneous movements can predict the long-term developmental disorders in high-risk infants. In order to develop algorithms for automated prediction of later disorders, highly precise localization of segments and joints by infant pose estimation is required. Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset, covering the large variation in 1 424 videos from a clinical international community. The localization performance of the networks was evaluated as the deviation between the estimated keypoint positions and human expert annotations. The computational efficiency was also assessed to determine the feasibility of the neural networks in clinical practice. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations, while still operating efficiently. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries by quantifying infant movements from video recordings with human-level performance.Comment: Published in Computerized Medical Imaging and Graphics (CMIG

The in-motion-app for remote general movement assessment : a multi-site observational study

Objectives To determine whether videos taken by parents of their infants' spontaneous movements were in accordance with required standards in the In-Motion-App, and whether the videos could be remotely scored by a trained General Movement Assessment (GMA) observer. Additionally, to assess the feasibility of using home-based video recordings for automated tracking of spontaneous movements, and to examine parents' perceptions and experiences of taking videos in their homes. Design The study was a multi-centre prospective observational study. Setting Parents/families of high-risk infants in tertiary care follow-up programmes in Norway, Denmark and Belgium. Methods Parents/families were asked to video record their baby in accordance with the In-Motion standards which were based on published GMA criteria and criteria covering lighting and stability of smartphone. Videos were evaluated as GMA 'scorable' or 'non-scorable' based on predefined criteria. The accuracy of a 7-point body tracker software was compared with manually annotated body key points. Parents were surveyed about the In-Motion-App information and clarity. Participants The sample comprised 86 parents/families of high-risk infants. Results The 86 parent/families returned 130 videos, and 121 (96%) of them were in accordance with the requirements for GMA assessment. The 7-point body tracker software detected more than 80% of body key point positions correctly. Most families found the instructions for filming their baby easy to follow, and more than 90% reported that they did not become more worried about their child's development through using the instructions. Conclusions This study reveals that a short instructional video enabled parents to video record their infant's spontaneous movements in compliance with the standards required for remote GMA. Further, an accurate automated body point software detecting infant body landmarks in smartphone videos will facilitate clinical and research use soon. Home-based video recordings could be performed without worrying parents about their child's development

The World Social Situation: Development Challenges at the Outset of a New Century

World social development has arrived at a critical turning point. Economically advanced nations have made significant progress toward meeting the basic needs of their populations; however, the majority of developing countries have not. Problems of rapid population growth, failing economies, famine, environmental devastation, majority-minority group conflicts, increasing militarization, among others, are pushing many developing nations toward the brink of social chaos. This paper focuses on worldwide development trends for the 40-year period 1970-2009. Particular attention is given to the disparities in development that exist between the world’s “rich” and “poor” countries as well as the global forces that sustain these disparities. The paper also discusses more recent positive trends occurring within the world’s “socially least developed countries” (SLDCs), especially those located in Africa and Asia, in reducing poverty and in promoting improved quality of life for increasing numbers of their populations

Early Intervention for Children Aged 0 to 2 Years With or at High Risk of Cerebral Palsy International Clinical Practice Guideline Based on Systematic Reviews:International Clinical Practice Guideline Based on Systematic Reviews

IMPORTANCE: Cerebral palsy (CP) is the most common childhood physical disability. Early intervention for children younger than 2 years with or at risk of CP is critical. Now that an evidence-based guideline for early accurate diagnosis of CP exists, there is a need to summarize effective, CP-specific early intervention and conduct new trials that harness plasticity to improve function and increase participation. Our recommendations apply primarily to children at high risk of CP or with a diagnosis of CP, aged 0 to 2 years. OBJECTIVE: To systematically review the best available evidence about CP-specific early interventions across 9 domains promoting motor function, cognitive skills, communication, eating and drinking, vision, sleep, managing muscle tone, musculoskeletal health, and parental support. EVIDENCE REVIEW: The literature was systematically searched for the best available evidence for intervention for children aged 0 to 2 years at high risk of or with CP. Databases included CINAHL, Cochrane, Embase, MEDLINE, PsycInfo, and Scopus. Systematic reviews and randomized clinical trials (RCTs) were appraised by A Measurement Tool to Assess Systematic Reviews (AMSTAR) or Cochrane Risk of Bias tools. Recommendations were formed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework and reported according to the Appraisal of Guidelines, Research, and Evaluation (AGREE) II instrument. FINDINGS: Sixteen systematic reviews and 27 RCTs met inclusion criteria. Quality varied. Three best-practice principles were supported for the 9 domains: (1) immediate referral for intervention after a diagnosis of high risk of CP, (2) building parental capacity for attachment, and (3) parental goal-setting at the commencement of intervention. Twenty-eight recommendations (24 for and 4 against) specific to the 9 domains are supported with key evidence: motor function (4 recommendations), cognitive skills (2), communication (7), eating and drinking (2), vision (4), sleep (7), tone (1), musculoskeletal health (2), and parent support (5). CONCLUSIONS AND RELEVANCE: When a child meets the criteria of high risk of CP, intervention should start as soon as possible. Parents want an early diagnosis and treatment and support implementation as soon as possible. Early intervention builds on a critical developmental time for plasticity of developing systems. Referrals for intervention across the 9 domains should be specific as per recommendations in this guideline

Prediction of cerebral palsy in young infants : Computer-based assessment of general movements

Cerebral palsy (CP) is the most serious chronic motor disability that can occur in infants. Despite improvements in care and reduced mortality among high risk term and preterm infants, the prevalence of CP is stable. Diagnosing CP is difficult and early identification of CP might be beneficial for early treatment when the plasticity of the brain is high. Hence, there is a need for accurate assessment methods to provide early clarification about CP development. Assessment of general movements (GMs), a part of the spontaneous movement repertoire, has proven to be reliable and sensitive in the early assessments of infants to identify CP. Using video recordings of infant spontaneous motor activity, observers classify the qualities of general movements into categories. In particular, the absence of so-called fidgety movements in infants at 9-20 weeks post-term age has been shown to be a strong marker for later CP. However, the GM assessment is qualitative and highly dependent on skilled personnel. It is reported to be limited in use in ordinary clinical practice. Recently, computer-vision-based human motion analyses have become possible, providing an inexpensive, non-obtrusive solution for the analysis of movement using video recordings. The aim of this thesis, which constitutes four different scientific studies, was fourfold; 1) to verify the GM assessment for prediction of CP used in a clinical setting and evaluate the inter-rater reliability in the assessment of fidgety movements, 2) to elicit expert knowledge about fidgety movements and identify possible objective characteristics using visual displays, 3) to develop a computer-vision-based method for identification of infants with present and absent fidgety movement characteristics, and 4) to evaluate the accuracy of the developed computer-vision-based method in the prediction of later CP. The results showed that GM assessment by the use of qualitative assessment of fidgety movements demonstrated high sensitivity and specificity in the early prediction of CP. The inter-rater reliability in the assessment of fidgety movements was good. The use of visual displays for observation of absent or present fidgety movements revealed important expert knowledge about periodic movement patterns. The use of a computer-vision-based tool, the General Movement Toolbox, demonstrated ability to detect absent and present fidgety movement characteristics and high sensitivity and specificity for prediction of CP during the fidgety movement period. The General Movement Toolbox also demonstrated high sensitivity and specificity, correctly predicting ambulatory or non-ambulatory function for 9 of 10 children with CP. This thesis provides a novel computer-based method for early prediction of CP in young infants based on a single video recording. The assessment instrument General Movement Toolbox is presented, showing promising prediction of CP and ambulatory versus nonambulatory function in children with CP. This thesis adds an early objective detection of movement hallmarks for later neurological disease to the field of neuromotor assessment of infants. It brings hope for earlier and more precise prediction of CP and evaluation on early intervention strategies in future research

Early Intervention for Children Aged 0 to 2 Years With or at High Risk of Cerebral Palsy

Importance Cerebral palsy (CP) is the most common childhood physical disability. Early intervention for children younger than 2 years with or at risk of CP is critical. Now that an evidence-based guideline for early accurate diagnosis of CP exists, there is a need to summarize effective, CP-specific early intervention and conduct new trials that harness plasticity to improve function and increase participation. Our recommendations apply primarily to children at high risk of CP or with a diagnosis of CP, aged 0 to 2 years. Objective To systematically review the best available evidence about CP-specific early interventions across 9 domains promoting motor function, cognitive skills, communication, eating and drinking, vision, sleep, managing muscle tone, musculoskeletal health, and parental support. Evidence Review The literature was systematically searched for the best available evidence for intervention for children aged 0 to 2 years at high risk of or with CP. Databases included CINAHL, Cochrane, Embase, MEDLINE, PsycInfo, and Scopus. Systematic reviews and randomized clinical trials (RCTs) were appraised by A Measurement Tool to Assess Systematic Reviews (AMSTAR) or Cochrane Risk of Bias tools. Recommendations were formed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework and reported according to the Appraisal of Guidelines, Research, and Evaluation (AGREE) II instrument. Findings Sixteen systematic reviews and 27 RCTs met inclusion criteria. Quality varied. Three best-practice principles were supported for the 9 domains: (1) immediate referral for intervention after a diagnosis of high risk of CP, (2) building parental capacity for attachment, and (3) parental goal-setting at the commencement of intervention. Twenty-eight recommendations (24 for and 4 against) specific to the 9 domains are supported with key evidence: motor function (4 recommendations), cognitive skills (2), communication (7), eating and drinking (2), vision (4), sleep (7), tone (1), musculoskeletal health (2), and parent support (5). Conclusions and Relevance When a child meets the criteria of high risk of CP, intervention should start as soon as possible. Parents want an early diagnosis and treatment and support implementation as soon as possible. Early intervention builds on a critical developmental time for plasticity of developing systems. Referrals for intervention across the 9 domains should be specific as per recommendations in this guideline

Early intervention and its short-term effect on the temporal organization of fidgety movements

BACKGROUND: The Prechtl General Movement Assessment (GMA) predicts various neurological and developmental disorders while also documenting therapeutic effects. AIMS: To describe the temporal organization of fidgety general movements in infants with mild to moderate postural asymmetries and/or tonus regulation problems, and to analyze to what extent the temporal organization of fidgety movements will change after physiotherapy. STUDY DESIGN: Repeated measure design. PARTICIPANTS: Twelve infants (five females) with mild to moderate postural asymmetries and/or tonus regulation problems were admitted for an early intervention program. The gestational age ranged from 27 to 40 weeks (Median, 36 weeks; nine infants born preterm) with birth weights ranging from 740 g to 3500 g (Median, 2590 g). MEASURES: Fidgety movements and their temporal organization were measured using the Prechtl GMA at 9 to 19 weeks post term age (Median, 14 weeks) before and after an early motor training procedure. The movements of one of the infants were analysed using a computer-based approach, measuring the mean and standard deviation of quantity of motion, height of motion and width of motion. RESULTS: Seven infants had sporadic fidgety movements, and five had intermittent fidgety movements. None had continual fidgety movements before the intervention was initiated. After intervention, the temporal organization of fidgety movements increased in all infants. The observations of these movements were supported by computer-based analysis. CONCLUSION: The study indicates that early intervention increases the temporal organization of fidgety movements in infants with postural asymmetries and/or tonus regulation problems. The clinical significance of this finding needs to be further evaluated

Towards human-level performance on automatic pose estimation of infant spontaneous movements

Assessment of spontaneous movements can predict the long-term developmental disorders in high-risk infants. In order to develop algorithms for automated prediction of later disorders, highly precise localization of segments and joints by infant pose estimation is required. Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset, covering the large variation in 1424 videos from a clinical international community. The localization performance of the networks was evaluated as the deviation between the estimated keypoint positions and human expert annotations. The computational efficiency was also assessed to determine the feasibility of the neural networks in clinical practice. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations, while still operating efficiently. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries by quantifying infant movements from video recordings with human-level performance

Correlates of Normal and Abnormal General Movements in Infancy and Long-Term Neurodevelopment of Preterm Infants: Insights from Functional Connectivity Studies at Term Equivalence

Preterm infants born before 32 weeks gestation have increased risks for neurodevelopmental impairment at two years of age. How brain function differs between preterm infants with normal or impaired development is unknown. However, abnormal spontaneous motor behavior at 12–15 weeks post-term age is associated with neurodevelopmental impairment. We imaged brain blood oxygen level-dependent signals at term-equivalent age in 62 infants born at <32 weeks gestation and explored whether resting state functional connectivity (rsFC) differed with performances on the General Movement Assessment (GMA) at 12–15 weeks, and Bayley III scores at two years of corrected age. Infants with aberrant general movements exhibited decreased rsFC between the basal ganglia and regions in parietal and frontotemporal lobes. Infants with normal Bayley III cognitive scores exhibited increased rsFC between the basal ganglia and association cortices in parietal and occipital lobes compared with cognitively impaired children. Infants with normal motor scores exhibited increased rsFC between the basal ganglia and visual cortices, compared with children with motor impairment. Thus, the presence of abnormal general movements is associated with region-specific differences in rsFC at term. The association of abnormal long-term neurodevelopmental outcomes with decreased rsFC between basal ganglia and sub-score specific cortical regions may provide biomarkers of neurodevelopmental trajectory and outcome